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A System for Processing and Decoding MPEG Compatible 
Data and Internet Information 



This is a non-provisional application of provisional 
ZTl997 60/043 ' 539 ^ R - J - L ° gan « «««-14 

Field of the Invention 

This invention is related to the field of digital signal 

Tmpp^' m ° re Particular, y to Pressing and decoding 

of MPEG compatible data and Internet information. 

Background of the Invention 

15 Home entertainment systems which combine Personal 

Computer and television functions (PC/TV systems) are 
increasingly becoming, generic, User interactive, multiple source 
and multiple destination communication devices. Such systems are 
required to communicate in different data formats between 

2 0 multiple locations for a variety of applications in response to User 
requests. For example, a PC/TV system may receive data from 

Trf °^w? Strial S ° UrCeS com P" sin S High Definition 

- Television (HDTV) broadcasts, Multi-point Microwave Distribution 
System (MMDS) broadcasts and Digital Video Broadcasts (DVB) A 
^.pTY. system , may., also receive and transmit data via telephone 
(e.g. the Internet) and coaxial lines (e.g. cable TV) and from both 
remote and local sources such as Digital Video Disk (DVD), CDROM 
VHS and Digital VHS (DVHS™) type players, PCs', and many other 
types of sources. 

30 A nunib « of problems arise in developing such a 

generic PC/TV entertainment system. Specifically, problems arise 
in supporting communication between multiple data sources and 
in processing data from the multiple sources. A problem is also 
presented by the need to devise a : :.User interface for such a system 

3 5 that supports complex User interactive tasks whilst providing a 
simple command interface suitable for the general public A 
PC/TV system User interface, for example, should allow a User to 
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view a selected program and permit User operation of functions 
such as Email, telephone, Internet access, fax and video-phone 
functions. Such applications require communication between a 
PC/TV unit and a variety of both remote sources e.g. a satellite 
5 service provider, and local sources e.g. a DVD storage device. 
Further, a PC/TV needs to process and decode data in different 
data formats from different devices and display received data to 
the User. These problems are addressed by a system according to 
the present invention. 

10 

Summary of the Invention 

The inventors have hereby- recognized that - a Program 
Guide type of User interface advantageously provides a simple, 

1 5 easy to use interface for User . operation of functions such as Email* 

telephone, Internet access, fax* home "i cointrol, arid- videb-phone 
functions. The use of a Program Guide for such functions also 
advantageously provides a single User interface for User operation 
of multiple devices and associated functions. 

2 0 The inventors have further recognized that it is 

desirable for a video decoder system to be capable of decoding 
input video data encoded in a plurality of encoding formats such 
as MPEG compatible and Internet compatible data formats. 
Further, that it is desirable for a decoder to be capable of 

2 5 displaying the decoded data derived from the different encoding 

formats e.g. decoded MPEG video program data arid web page 
Internet data as a composite video image. 

A video decoder system decodes input video data 
encoded in a plurality of encoding , formats. The decoder includes a 

3 0 first processor for decoding MPEG compatible data identified by a 

first data identifier to provide a first decoded video output. The 
decoder also includes a second processor for decoding data 
encoded in an Internet compatible data format identified by a 
second data identifier to provide a second decoded video output. A 
3 5 display processor formats the first knd second decoded video 
outputs for display as a composite video image and the proportion 
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of the video image contributed by the first and second decoded 
outputs .is variable. , 

Brief Description of the Drawings 

In the drawing: . . .. 

Figure 1 shows a home entertainment decoder system 
according to the invention, for communicating with a plurality of 
sources and for processing program guide information and 
1 0 program content data. 

Figure 2 shows an exemplary Program Guide display 
format according to the invention.- * 

15 .:: n^FteWSr^t shows, ;;a r data< "format; ' according to the * 
f P5:/PackeMzing .rnterner ^dat* for transmission within an 
MPEG .compatible datastream. 

Figure 4 shows a flowchart, according to the invention 

2 0 for receiving program guide information including User selection 

options and processing the received information to form a ' 
program guide supporting User selectable > communication 
functions. - . 

25 -. *.. Fi g»re 5 shows a flowchart, according to the invention 
,,for a process to form a program guide in a video decoder from 
information received from a plurality of sources.' 

Figure 6 shows a flowchart, according to the invention, 

3 0 for, a process to automatically acquire and collate program guid* 

information from a plurality of sources arid to form a program 
guide for display. 

Figure 7 shows a black and white representation of an 
3 5 exemplary color Program Guide display format, according to the 
invention, showing : menu options permitting a User to collate 
programs by source and color attribute. 
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Figure 8 shows a flowchart, according to the invention, 
for a process to acquire information requested by a video receiver 
User via a selection made from options on" a displayed program 
5 guide. ; . 

Figure 9 shows a flowchart, according to the invention, 
for a process to decode input Internet information and 
compressed video data and to form a composite video output for 

1 0 display. 

Detailed Description gf the Drawings 

Figure 1 snows a hb'me' "ejit,er.taihment" decoder system,. 
1 5 according to the invention, r for communicating with multiple 
sources" to acquire' program" guide' ^ information and program 
' content data. The decoder system forms a program guide for 
display from information acquired and collated automatically from 
multiple sources. A User may initiate "„ Email, telephone, Internet 

2 0 access, fax and video-phone functions via selection of options from 

the displayed program guide: The decoder system adaptively 
decodes a datastream encoded to. the MPEG standard incorporating 
compressed program content data and Internet data 
representative of,, for example. Hypertext Mark-up Language., 

2 5 (HTML). The decoded data is formatted either as a composite 

video image or as separate video images ! for display. 

The MPEG2 (Moving Pictures Expert Group) image 
encoding standard, hereinafter referred to' as the "MPEG standard" 
is comprised of a system encoding section (ISO/IEC 13818-1, 10th 

3 0 June 1994) and a video encoding section (ISO/IEC 13818-2, 20th 

January 1995), hereinafter referred to as the "MPEG systems 
standard" and "MPEG video standard" respectively." 

Although the disclosed system is described in the 
context of a system for, receiving an MPEG compatible signal, it is 
3 5 exemplary only. The principles of the invention may be applied to 
systems in which' the types of transmission channels and 
communication protocols may vary, or to systems in which the 
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coding type may vary. Such systems may include, for example, 
non-MPEG compatible systems, involving other types of encoded 
datastreams and other methods of conveying Program Guide 
information, Further, although the disclosed system is described as 
5 processing broadcast programs, this is exemplary only. The term 
'program' is used to represent any form of data such as telephone 
messages, computer programs, Internet data or other 
communications, for example. 

In overview, in the video receiver system of Figure 1 , 
1 0 a carrier modulated with video data is received from a broadcast 
satellite by antenna 10 and processed by unit 15. The resultant 
digital output signal is demodulated, by demodulator 20 and 
decoded and error corrected by decoder ' 30. In this exemplary 
embodiment, the demodulated and decoded output from unit 30 is 

1 5 . in the farm, of an. &PEG compatible ' transport stream containing 
M p Ep compr^ssea .Video' 'drta 'and.. Internet "data.' encoded in HTML. 

Video data encoded'*' to the MPEG standard is in the form of a 
packetized datastream which typically includes the data content of 
many prbgrarn channels " (e.g. content .corresponding to cable 

2 0 television channels 1-125). " J " ! 1 

The MPEG .compatible transport stream is .proyided to 
? roc .?. s *?* £5 . which Js." responsive /to commands , 'from , remote 
, .''^ontrol^'unit 125. Processor". 25 communicates with 1 other data 
^'^ourc^s* A including ' storage, f device, '.90 and either ^nternit data 
2 I?i-i^Y®t.' 83 ' or "Internet ' connection' service' 87 (e.gY. !Xmepca On- 
line 1 ^). Program guide " information is ' acquired and" collated 
automatically from the input transport stream . and. .. "storage device 
/ 90 and either server "83 or connection, service J7. .The acquired 
information is merged by processor 25 to form a program guide 

3 0 for display incorporating selection options allowing a User to 

initiate Email," telephone, 'Internet' access,' fax" and video-phone 
functions among others, . for example. The program guide for 
display is also formed, to 'include non-displayed information from 
multiple sources _for. identifying and "assembling individual data 
3 5 packets that constitute . the programs that are selected for User 
viewing or listening. This information is used in recovering the 
content of selected' programs from multiple sources. ' 
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Processor 25 adaptively decompresses tHe input 
compressed video data and decodes the HTML Internet data to 
. .provide a formatted composite video image for display on unit 75. 

Processor 25 also provides encoded data outputs for storage on 
5 storage medium 105 via storage device 90, and provides- encoded 
data to other devices (not shown to simplify drawing) via modem 
80 and telephone lines. 

A video receiver user initiates functions including 
Email, telephone, Internet access, fax and video-phone functions 
1 0 and viewing and storage of selected programs via selection of 
options from ^ the displayed .program guide: A User selects a 
displayed option with a cursor using -remote control unit 125. 
Commands, from; remote- control 125: are- '-passed via interface 120 
to controller, 115^-:;within-..;.pr6c'ess6r.-- 25. Uivit" 115 ' controls^ the 

1 5 operatipn of the -elements of; processor 25 "and- responds to^ remote 

control unit . 125 commands using • a -bi-dire6tiorial %ata and control 
signal bus C. Controller 1 15 controls the functions - of individual 
elements within processor , 25 by setting - control , register values 
within these elements with control bus C. Processor 25 also 

2 0 supports the storage and retrieval of data from storage medium 

105 via storage device . 90. Storage, device 90 is a DVD type device 
and medium 105 comprises . a multi-disk stack unit containing a 
plurality of disks in this exemplary embodiment. 

^ Considering Figure 1 in detail, a carrier modulated 

2 5 with video data received by antenna 10, is converted tcf digital* 

form and -processed ; by input processor 15. Processor 15 inclucies 
■ : radio frequency, ; (RF) tuner and intermediate frequency (IF) mixer 
and amplification, stages for down-converting the input video 
signal to. . a low^r ■ frequency band. Processor 15 also includes an 

3 0 analog to digital converter for digitizing the down-converted 

signal to produce a signal suitable for further processing. The 
■resultant digital output signal is demodulated by demodulator 20 

and decoded and error-corrected by decoder ■ 30. The output from 

decoder 30„ is further processed' by unit 45 of processor 25. 
3 5, . JThe data provided to unit 45 is in the form of an MPEG 

.compliant packetized transport datastream as defined in MPEG 
-systems.; standard : section. 2.4 - and includes program guide 
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information and the data content of one or more program 
channels. Processor 25 acquires and collates program guide 
information., automatically from the input transport' stream and 
storage device 90 and either Internet data "server 83 or Internet 

5 connection service 87 (e.g. America On-line™). The individual 
packets that, comprise either particular program channel content, 
or Program Guide information, are identified by. their Packet 
Identifiers (PIDs) contained within. -header information. 

In response , to. control- signal C, unit 45 selects either 
10 the transport stream f^om ;unit : 30 > or in a playback mode, a 
datastream retrieved .from- storage rdeyibe - 90 ^ via store interface 
95. In normal, Jion-playback operation, individual packets that 
comprise, program, guides infdrmatron^ a*et identified by -unit 45 in 

... ^e/^sgort-j^re^jfroM unit sa ^ndr^ssembled using PIDs that 

1 5 . .are.. pxed.etgj^in^dcdWidirstpced .in: i'ntefnal niambry bf controller - 

115. .Unite,. 46 ;jn;a-tch*Sb-«b;e i;PIDs-/ af-.^in-cbmmg--pac'KasV''m' the 
transport datastrea.my from decoder 30 1 with PHD 'values pre-loaded 
in . conttol. : regi.st9r.§-.witf>in^unit/.45. by -controller 115. Therefore, 
satellite broadcast program guide . (SPG) - information packets in the 

2 0 transport stream are identified^by unit 45 without additional PID 

information. - Controller 115- acquires , a full - SPG by ^ accessing and 
assembling the SPG packets,: that --are*.. identified and -captured by 
unit 45. ■ • ; ■ ^ \, , 

••• . The PID information that enables controller 115, in 

2 5 conjunction with unit 45, to identify data packets: that : comprise 

individual programs is termed a program , or ^channel map. The 
program map associates PIDs with .; individual; .rpaeketized 
datastreams that constitute a program and is part > of the ^SPG. The 
SPG may also contain additional information, : e:g/» packet ^assembly 

3 0 information, supporting the recovery of program' : guide data from 

.the input transport stream. - • .-. -«. 

Controller M5 also configures unit 45' using Control 
signal C to select the -data packets comprising the DVD program 
guide (DPG) information derived from DVD storage device 90 via 
3 5 interface 95. Unit 45 matches the PIDs of incoming: packets in the 
packet datastream from interface 95 with PID values pre-loaded 
in control registers within , unit 45 by controller 115. Controller 
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115 acquires a full DPG by accessing and assembling the DPG 
packets that are identified and captured by 'unit "45. 

A similar process is followed in acquiring Internet 
program guide . (IPG) information from Internet server 83 or from 
5 Internet connection service 87 by telephone line communication 
via modem 80. In acquiring the ' IPG, data identifiers analogous to 
or the same as the PII>s used in acquiring the SPG or DPG are 
matched with identifiers pre-loaded by' controller 115. The 
matching function may be performed' either within unit 80 or by 
10 controller 115. The process ; : for acquiring program guide 
information is explained in greater detail in the description , of 
Figures 4-6. 

The SPG, DPG and IPG ' information acquired by 
controller 115 is merged "by processor "25' to fonn a program guide 

1 5 for display incorporating selection' options 'allowing "a " User', to 
initiate Email, telephone, Internet access, fax arid video-phone 
functions. In merging the data, the acquired SPG, DPG and IPG 
information is collated into two levels of hierarchy termed theme 
and topic and redundant program guide information is eliminated. 

20 A theme, for example, may include categories such as movies, 
sports, weather, arts, documentaries, news, etc. A topic is a 
category within a theme, for example, a movie theme category 
may have topics including, comedy, thriller, horror, science fiction, 
romance, adult entertainment, etc. Different or additional levels of 

2 5 hierarchy may be used in collating the acquired SPG, DPG; arid IPG. 

information involving criteria such as * viewer age suitability , * the 
period setting e.g. contemporary or historical, reviewer ratings etc. 
: A number of problems occur' in collating the SPG, DPG 

and IPG information. The SPG, DPG and ' IPG information, being 

3 0 from different sources, may categorize programs by different 

themes and topics arid may use a different sorting hierarchy. 
Further, the' SPG, DPG and IPG data may use conflicting, redundant 
or incompatible PIDs or other data identifiers for identifying 
individual data elements that comprise particular program 
3 5 channel or guide content. Controller 115 creates a master set of 
themes and topics mapping" the SPG,* DPG and IPG information to a 
corresponding category in the master set. For example, the 'master 
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set may. contain an encompassing topic-theme of 'movies-comedy' 
to which is mapped both, a) the DPG topic-theme of 'movie- 
parodies', and b) the IPG Internet topic-theme of 'movie-synopsis 
. index' (an index of web pages). In collating the guide information, 
5 controller 115. determines the. topic and theme categories of the 
data in the SPG, DPG and IPG from pre-determined . theme-topic 
codes. The SPG, DPG .and IPG theme and topic codes together with 
^equivalence .mapping information for converting codes of one 
service provider, to those of another, are acquired from the SPG or 

1 0 User defined data input to processor 25 or are pre-stored in 
internal memory within controller, 115.. Controller 115 assembles 
the collated SPG, DPG and IPG packets according to the categories 
defined by the mastej ^: set <r of themes , and topicsL. r The assembled 
collated;, SP/3, £PG and^iPG data, is stored . by controller .1 15 in 

15. internal Memory ipr u^e ;r pi f^ing^a composite program guide for- 
display.. ". . ' .. '' " - 

, . Cont^pll^r 115 also forms „• MPEG compatible non- 
displayed information,- associated with, the displayed- composite 
program guide, the non-displayed, information includes composite 
2 0 program map, conditional ac.cess and network information. This 
non-displayed information |s : required to support identification, 
..assembly ancj decoding of the packets comprising the composite 
^.^fogram^.... .guide and the associated program content. The 
r v C °-$£ ona - : ac cess information governs access to programs, based 

2 TJ^TOu:*^: entitlement.!. Tjie ' ^network information defines physical 

network parameter^ such as satellite transmission channel 
frequencies and . transponder channels, for example. 

Controller 1.15 forms composite program map 
v Jri° rm&tion f or the . composite program guide that maps the SPG, 
3 ^ DP ^ and IPG * hemes topics to the master set of themes and 
t 0 P ics ; The composite program map also associates data identifiers 
^ ^ •j : PID . r^ alues) with individual packetized datastreams that 
.. con sAtme programs listed in the composite program guide. The 
composite program map information may also include a dedicated 

3 5 indicator to denote^ that a particular program has associated 

Internet web page information available. In forming composite 
program map information, controller 115 examines the SPG, DPG 



WO 98/47286 



PCT/lf^/1703^6' 



10 

and IPG information for., data identifier omissions, Redundancies 
and conflicts. Controller 115 re-numbers existing data identifiers 
and creates new data identifiers as required to produce MPEG 
compatible program map information for both the collated 
5 program guide information and the associated program content. 

Controller 115 also forms MPEG: compatible conditional 
access information and network information from corresponding 
information received in the SPG, DPG and IPG data. The conditional 
access information includes, data such as encryption codes that 

1 0 govern access to programs that are dependent upon user 

entitlement. The network information, defines physical network 
parameters such as satellite, transmission : channel frequencies, 
transponder ; channels, ; and Internet access parameters associated 
with the composite program giiide;Tof:.:dis^lay;o-The--*'cdmposite 
1.5, program map, conditional access' : : and.; network information 
supports assembly, decoding and display of the*-- program content 
available from the satellite, storage and Internet server sources as 
well as the composite program guide. : ; 

, Controller 115 also includes additional linking data in 

2 0 the non-displayed composite program map, conditional access and 

network information. The additional linking data supports the 
User selectable functions such as Email, telephone, Internet access, 
fax, video-phone, channel tuning, program recording and home 
control functions. Home control functions may- support User 

2 5 control of lighting air conditioning; heating and burglar al-a^m^ - 

operation, for example. The , additional: linking data associates 
access data, both with data identifiers (e.g. -PIDs) of requested 
data, and with User selectable menu options in the displayed 
composite program guide. The access data includes identification 

3 0 codes, communication protocol codes, conditional access >cddes, : 

Internet access codes e.g, .URL codes for web page and Email access 
as well as telephone and fax numbers. The, access data enables 
processor 25 to communicated with external devices. 

In order -to generate the composite* program guide for 
3 5 display, controller , 115 retrieves the assembled and collated SPG, 
DPG and IPG packet data* previously stored in internal memory. 
Controller 115 both, converts the .retrieved data to pixel data and 
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formats the converted data for storage in a pixel "representative 
memory .map . contained in display processor 70: : In addition, 
controller. 1 15 creates User selectable menu options (for User 
selection, of Email, fax etc.) in -pixel data form for incorporation in 
5 the unit 70 pixel; memory map. Controller 115 stores the 
formatted SPG, DPG: and IPG pixel data together with the 
generated option pixel data in the unit 70 pixel map to form the 
composite program guide for - display. 

The composite program guide, combining the SPG, DPG 
1 0 and IPG data and User selectable options, is formatted to be 
compatible with the • linking, data in the non-displayed program 
guide information. For example, a User selectable option in the 
displayed guide, (e.g. for .a telephone function) is associated, both 
.with, access :data' for. the function (e.g.: a' .telephone number), and 
15 with data identifiers- (e.g.. PIDs for data packets of transmitted and 
received: telephone messages). : . • *: • i . . . 

.<•■"..: Display - processor 70. converts the • stored and 
formatted program guide data into conventional luminance and 
chrominance .components. The luminance and chrominance 
2 0 components, together with timing data provided by. controller 115, 
are processed by processor 70 in a conventional manner to form 
an NTSC signal for display on NTSC compatible image reproduction 
device. 75 e:g. a television or video monitor. Processor 70 may, in 
. another embodiment, provide RGB output data for display by an 

2 5 RGB compatible, reproduction device or a high definition television. 

. . :•- . Controller .115, in conjunction with processor 55, forms 
an MPEG compatible datastream of compressed video and audio 
data containing the composite program guide and program 
content. Processor 55 separates system- information including 

3 0 timing, error and synchronization information from the 

datastream from unit 45 and diverts it for use by controller 115. 
Controller 115 applies the system information in controlling 
processor 55 to provide re-synchrohized, collated program and 
composite, program guide . data together with synchronization and 
3 5 error indication information for use in subsequent program 
content data . decompression. . by. . decoder 65. The composite 
program guide data provided by processor 55 combines the SPG, 
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DPG and IPG data and User selectable options in a manner 
compatible with the program map linking information as 
previously described. The program content data. " provided by 
processor 55 is decompressed by f MPEG decoder 65 to provide 
5 video pixel data and audio output data to processor 70. Display 
processor 70 processes the video pixel data and audio output data 
to be suitable for reproduction by unit 75 as previously described. 

Figure 2 shows an exemplary displayed composite 
program guide. Menu features 833-850 show program services 
10 and functions. Menu features 833 and 835 show program channels 
"which may be invoked arid displayed upon highlighting of the 
corresponding menu feature using a User selection control such as 
a remote control directed cursor. If a User'.'.highlig'nts. feature .8 ; 33 
with the cursor, i.e. selects menu option 8,33^ for example, 

1 5 processor 25 tunes tb television'' channel 1 07 '(K&E™)\ahd displays 

it on unit 75 using the composite ^ "nbh-displaye'd program guide 
information to determine the function activated and associated 
tuning information (channel frequencies etc.): Similarly, if a User 
highlights feature 837, processor "25 tunes to receive radio channel 

2 0 FM 13 for audio output on unit 75. Upon highlighting features 

840-850, corresponding to Email, telephone, fax and DVD 
record/playback functions respectively, additional function 
specific menus become displayed providing further User selection 
options. Such function specific menus may provide a User .with the, 

2 5 ability to edit, store and delete access information inclu^mg^ for 

example, telephone numbers, Email addresses, Internet addresses, 
credit card numbers and additional conditional access data. 

If a User highlights menu features 860-870 specific 
function tasks are initiated: Upon a User highlighting feature 860, 

3 0 for example, a further menu is displayed prompting the User to 

venter an Email message to be sent to John Smith at his home via 
an Internet Email address retrieved from the composite non- 
displayed program guide information. Similarly, in response to a 
User highlighting feature 865, for example; * controller 115 (Figure 
3 5 1) retrieves Jean's home telephone number from internal memory 
using the composite non-displayed program guide information. 
Further, controller 115 establishes telephone communication, via 
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modem 80, with Jean at her home by dialing Jean's home 
telephone number, Also, upon a User highlighting feature 870, for 
example, the movie 'Star Wars™' is re-played from DVD unit 90 
(Figure 1). The communication between processor 25 and DVD 
5 unit 90 is established with access data retrieved from memory 
within controller 115 using the composite, non-displayed . program 
guide information. 

In addition, the program guide may -include one or 
more icons, such as icon 873 (Figure 2) depicting a home, for 
10 example, to indicate whether , Internet information such as a 'home 
page' is available for a particular program. Further, icon 873, in 
Figure 2 may change color e.g.. Jjom white to green to indicate 
Internet .information, is. available for. a particular program. 
Alternatively, ippn 8.73 ? .niay>e a pop-up icon which appears as- an 
15 indication-, tjiat^ internet J information is available for a particular 
^rp'gram.. TJhe ^played program, guide may be formed to enable a 
/.?5®5 ..}?■■ ^^rinttinei\MpTi^atiqn on a particular program by 
; highlighting the. program followed by highlighting the pop-up icon, 
for. example. Home page icons , that are present when Internet 
2 0 information is available may also located within or adjacent to 
program icons, e.g. icon 859. Further, the home page icon may 
change color upon User selection of the information by 
highlighting the home page icon. ' 

. ., Although Internet informatioii may be retrieved upon 

2 * :^^ 1 nfn^ ng .'- a '- w * b P ag - icon sucn as icon 857,„ in Figure 2, this is 

exefhpjary ,>nly.. Retrieval of Internet ..information jnay also be 
initiatedj ? n "* l ' variety of. other ways. ' A. usei' * may. 'redeye.! .available 
Internet information relating to a program^ by "highlighting a 
program icon such as 'Seinfeld™v u S i ng icon 859 . followed by 

3 0 highlighting Internet " icon 810, for example... , 

Upon User selection of a composite ! program guide 
function, controller 115 (Figure 1) determines and applies the 
access data associated . with both /request^ and response operations 
involved in the selected ..function. ' Controller 115 determines the 
3 5 access data required for," the .'"request and" response' operations from 
the previously formed . non-displayed, composite "program map, 
conditional access and network' information. 
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Processor 25 acquires information, such as web page 

- data, in response to a User request, in a number of ways, 
including, for example: " . , . 

5: a) In a first configuration, processor 25 accesses web 

page data that is continuously transmitted in the satellite 
broadcast received from decoder 30, - 

b) In 'a second configuration, processor 25 acquires 

1 0 web page data that is transmitted in the satellite broadcast 

received from decoder 30 in response to an information request to 
a service provider via telephone line, and' 

1 ■ c)- In "a third -configuration, processor i5 both requests , 
1 5 information and ' receives- response 'Information on the same 
communication link e g. on the /telephone' link to server 83 . 

First configuration of Pr ocessor 25 \, 

20 In the first coiifiguratibn, web page data selected by a 

User via the displayed program guide is continuously transmitted 
within the transport datastream input to processor 25 from 
decoder 30. In this configuration, the composite program map 
information contains predetermined PID values for the Requested ^ 

2 5 web page. Consequently, the requested web page data is retrieved 

from the input transport stream using the composite program map 
information without the need for controller 115 to communicate 
with a service provider via modem 80. In this configuration, the 
web information available to a User is limited to the specific 

3 0 information that a service provider continuously transmits* to 

processor 25 using dedicated transmission bandwidth. However, 
this configuration is simple and offers quick web page access 
(since the web data may be stored locally at the encoder by the 
service provider). This configuration also minimizes the service 
3 5 -provider burden of data acquisition and eliminates the need for 
processor 25 to communicate web page request information to a 
service provider. 
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The web page information, encoded in HTML™ and 
Java™, i s packetized and formatted in an encoder by the service 
provider for incorporation into the MPEG transport datastream for 
transmission. Figure 3 shows a data format, according to the 
5 invention, for packetizing Internet data for transmission within an 
MPEG compatible datastream. A sequence of HTML™/J a va™ web 
pages (705-720 of Figure 3) is formed by the encoder into non- 
compressed packets with ancillary information and HTML™/Java™ 
data (725). The ancillary information includes PID, values, a packet 
10 count value, and individual web, page- size (e.g. number of : bytes or 
image pixel size). The ancillary > , infprmation L; may ; also include: a 
flag to indicate that a. ^particular,, transport "packet contains web 
page information; a start " code; a web page identification code; an 
error correction. .^q4e...and v; , a .timing parameter., suitable for 
15 synchronizing ^,,1?^ ;Inteniet; information, with an- associated - 
video ot ( au.d|o progtamj TM^fejb.. p^e7flag_. il9 iay ^.bg. ,' r u^ei' to 
facilitate identification and separation of the web page 
information from the MPEG compressed -video data. Further, one 
or more elements of the web page ancillary data ' may be included 
2 0 within User def inable . elements , of . the MPEG transport syntax, such 
as within the transport header, or it may be included along with 
the web page information in the MPEG transport data pay load 

. The response web page information, including a 
Jf^ d&t :" mi ^ d PID value ' is incorporated in the MPEG compatible 

2 5 transport datastream input to processor 25 (Figure 1). by the 

service provider. The response channel predetermined PID value 
is also prestored in controller 115 internal memory .. and 
incorporated in the composite program map information. As an 
alternative, the response data PID value and associated program 

3 0 map. data may be encoded, for example, in a Channel information 

.Table (CIT) in a high definition television (HDTV) signal encoded 
' according to the. Digital Television. Standard for HDTV 
Transmission of April 12 1995, , prepared by the United States 
Advanced Television Systems Committee (ATSC). In such a case, 
3 5 one or more specific .pre-determined program . channels may be 
designated, to convey web page response information. Further, the 
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PID values of the program channels may be conveyed in a CIT in 
the composite, program map information, for example. 

Controller 115 derives the predetermined PID' value 
corresponding to the requested web page ' response information 
5 from the stored composite program map information and loads it 
into control registers within unit 45. Unit 45 matches the PIDs of 
» incoming packets of web page response data in the transport 
datastream from decoder 30 with the PID value pre-loaded in the 
unit 45 control registers. The packets with PID values matching 

1 0 the pre-determined web response PID value are identified as web 

page response data and are provided by unit 45 to a dedicated 
buffer in decoder 55." The dedicated buffer in transport decoder 
55; holds response data to be decoded ! by ; processor 60: 

.Processor 55 denves '" system -ihfo'rrriitibn ' including 
15 timing, errbr and synchronization -information from' the' 
datastream from ' unit 45 and : provides : it to : 'controller 115: 
Controller? 115 applies the system information in directing 
processor 55 to provide re-syrichronized web page response data 
from the dedicated buffer in. decoder 55 to HTML™/Java™ 

2 0 processor . 60. Processor 60 decodes . the HTML™' and Java™ encoded 

web response information and provides web page image 
representative pixel data for "storage in memory within controller 
115. Although processor 60 is shown as a separate processor in 
Figure 1, 'it may also be implemented within the software' of ^ 

2 5 controller 115. Processor 60 comprises the processing functions^ of~ 

a special web browser, including JPEG decompression arid Jiva 
decoding such as involved in the operation of Netscape 
Navigator™i ' for example. 

Program content data e.g. a User selected television 

3 0 program channel, within the MPEG compatible transport 

datastream from decoder 30, is also decoded into pixel 
representative data by processor 25 in addition to the web page 
response data. For this purpose, controller 115 determines the PID 
value of the selected' television channel program from the 
3 5 composite program map information and loads it into control 
registers within unit. 45. Unit 45 matches the PIDs of incoming 
jackets of selected television channel program data in the 
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transport datastream from- decoder 30 with the PID value, pre 
loaded in the unit 45 control registers. The packets with PID 
values matching the predetermined selected television channel 
program PID value are : identified and provided by unit 45 to a 
5 dedicated application, buffer in decoder 55. 

■ ^ • As previously described for the web page response 

data, processor 55 derives -system information including timing 
error and synchronization information from the datastream from 
unit 45 and provides it to . controller 115. Controller 1 15 applies 
10 the system information in, directing processor ,55 to provide re- 
synchronized program channel , content data from the application 
buffer m decoder 55, to -MPEG decoder" 65. The r.MPEG compatible 
program channel , content .data, ,is v f decompressed by MPEG decoder 
65.to. pr | oy.^e 5 . yi4eo pjxe^ata . .and- audio .output: data to display 
15 processor 7.Q. ;/The. i: yideo pixel .data from, decoder 65, is stored: in a ^ 
-Pixel, ^epre^ntadve memor^^ontained^dn (display r _ processor 70. 
; • Controller: 1,15 .retrieves, the web ; page^ image ;pixel data 
. : from .internal memory, and formats, it ? for . storage as; an overlay in 
. the .pixel ; representative, memory contained., in display processor 
20 7°- As su <* a : .merged display,, combining ; the 5 . web page, response 
data and program channel content, is . formed within, the 'pixel 
. , memory of processor 70. The, relative- proportions- and .sizes, of the 
w : e^,page image and channel- content, image wi thin -the .resultant 
r composite image, formed, in the... processor 70 : pixel! .memory, may 
2 f b fnXm* by controller 115 in response, to, internal: programmed 
»«*H : - or- , .external,-: .e.g.. : User, command. The relative 
. proportions may . be, .varied so : that either the, web. , page,, image or 
channel content image contributes between 0-100%. of the 
resultant composite . image. - 

30 In order to adjust the proportion, of the composite 

, image .contributed by the- web page data,, controller 115 scales the 
web page image, pixel data by a conventional , interpolation 
■process, Alternatively, the .data may - be scaled by a separate video 
processing integrated . circuit . operating, in conjunction with 

3 5 controller 115. The resulting, scaled web-, page- .image is stored 
within the processor 70 pixel .memory by controller 115. The 
stored .web page image represents an. overlay image .with respect 
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' to the program channel content image. In order to adjust the 
: location of the web page image data within the composite image, 
controller 115 determines the addresses corresponding to the 
desired memory locations from internal memory map data and 
5 stores the scaled web page image data at the desired memory 
locations. As previously explained, display processor 70 converts 
* the formatted composite image data intci conventional luminance 
and chrominance components. Further, processor 70 processes the 
luminance and chrominance components, together with timing 
10 data provided by controller 115, in a conventional manner to form 
an NTSG signal for display on NTSC compatible image reproduction 
device 75. 

Second configuration of Processor 25 / * V ! 

fn the second configuration, processor 25 of FigiireJ 1 
acquires web page data that is transmitted in the satellite 
broadcast received from decoder 30 in response to an information 
request to a service provider via a telephone line. Upon a User 
2 0 requesting web page data, e.g. by highlighting web page icon 857 
in Figure 2, controller 115 (Figure 1) uses the request access data 
(telephone number, requested web page identifier code (e.g. URL) 
and conditional access data) to establish communication with the 
satellite broadcast service provider. ' , 

2 5 • ■ Prior to establishing communication with the servicef 

provider, controller 115 determines from conditional access 
information whether access to the requested web page 
information is authorized. Authorization may be determined 
directly from the ; program guide conditional access information or 

3 0 indirectly from a User entitlement device such as a smart card 

(not shown to simplify the drawing) within processor 25. If access 
is authorized^ controller 11 5 establishes telephone communication 
with the satellite broadcast service^ provider by dialing a 
telephone number via* modem "80 and ' transmitting request 
3 5 information e.g. requested web page identifier code (such as a 
URL) and user entitlement code; The service provider incorporates 
the requested web page information in the* transport daf as tream 
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transmitted, to processor 25 via antenna 10, processor 20 and 
decoder 30. Controller 115 uses the response ■ access data (PIDs of 
the. web ; page, data, response program channel number and 
transponder number), to identify and assemble the web page 
5 packets in the .transport stream as described for the first 
configuration of processor 25. 

The PID . values of the response web page information 
and corresponding program map. information may be 
communicated between, service provider and processor 25 in a 
10 variety of ways and in a variety of data formats. The PID values 
and program map . information, may . be conveyed, for example, in 
accordance with proprietary or custom requirements of a 
particular system such as within MPEG user definable data 
elements or within non-MPEG data such as within the vertical 
15 blanking interval (overscan region) of" a broadcast television 
signal. Further, the PID .values .allotted to. the web information 
may also be transmitted to processor 25. in supplemental, program 
guide information. As another alternative, the PID values to be 
used for response data may be determined by a service provider 
2 0 from information transmitted from processor 25. 

Third configuration n f P ressor 25 

In a third configuration, processor 25 both requests 

2 5. information, and receives response information, on the same 

communication link e.g. on the telephone link to server 83 or 
connection service 87, via modem 80. In this configuration, 
controller 115 requests Internet web page information by 
highlighting icon 857 (Figure 2), for example. Whereupon 

3 0 controller 115 (Figure 1) uses request access data (telephone 

number and URL code and conditional access data) to establish 
: internet access and request web page data at the URL address via 
modem 80 and server . 83. Controller 115 determines, whether the 
requested Internet access is authorized from conditional access or 
3 5 smart card User entitlement information as described in 
connection with . the second, configuration of processor 25. If 
authorized, controller 115 establishes telephone communication 
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with a service provider via server 83 by dialing a telephone 
number using modem 80 and transmitting the Internet URL 
address code and user entitlement code, for example, as 
previously described. Controller 115 : uses response access data 
5 (including Transmission Control Protocol/Internet Protocol 

* (TCP/IP) identification data) determined from the composite 
program map information to identify and assemble the web page 
TCP/IP packets containing the web page HTML "and associated 
JAVA data (and other data e.g. JPEG, GIF, TIF type ; data) in the 

1 0 response datastream from server 83. 

The response web page TCP/IP packets are buffered 
within modem 80 and provided to HTML™ processor 60 under 
command of- controller 115. Processor 60 decodes the HTML™ and 
Java™ encoded; web' response' iiiformad6n ! 'an'd_ provides' web page 

15 image representative ' pixel* data for- storage in memory - within 
controller iVs. Controller 115 retrieves - the web page "image pixel 
data from internal memory and formats it for storage as- an 
overlay in the pixel representative memory contained in display 

• processor 70 for reproduction by unit 75 as a merged display, as 
2 0 previously described. In this configuration, processor 25 supports - 

full Internet access via server 83 using the displayed program 
guide. For example, upon a User highlighting icon 810 followed by 
icon- 830' (Figure 2) controller 115 (Figure 1) executes web page 
browser fimctions and displays either a custom web page browser 
25 or a standard browser display such as : Netscape'* Navigator™ • 
through which full Internet access is available. 

Alternatively, in the third configuration, processor 25 
may support a limited Internet service. In this case, access to the 
Internet network via server 83 is under the control of a service 
3 0 provider that allows only indirect Internet access. The service 
provider provides collated Web page information for display 
compatible" with the displayed composite program guide. ^The 
service provider stores a limited number of web pages locally 
within server 83 that are accessible by processor 25 using the 
3 5 composite program map information Which provides an index to 
the available web pages and -their corresponding predetermined 
PIDs. Alternatively, the service provider may alter the- selection of 
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web pages available from server 83 and periodically provide 
updated. , compatible supplemental ..program guide information to 
processor. 25 via the satellite broadcast datastream. 

The supplemental program guide information enables 
5 processor 25 to form an updated displayed guide together with- 
compatible program map and, other access information enabling a 
User to access the updated web information. By storing the web 
page Internet information locally in server 83 the service 
provider retains control of the Internet, content available to a User 

10 and is able to bill the User -for, 'the material -provided! Also, the 
local storage of the web page information in server 83 provides a 
User with faster access, -to, the information, without .the full delay 
associated, with,. normal Internet .access,. Further,, . the burden, on 
processor .25, -of communicating information : requests to "external 

15 devices , is ^imm^iz^..m^ thsd, only, a.; limited quantity r of Internet 
information- ...may.. ,. be, . requested, and processor .25 need" only 
communicate with local, servers such as .server . 83.. It is ,to. be noted 
that modem , 8Q may , also be a wide,. ..bandwidth -communication 
modem such as a cable modem. In., which case, processor 25 may 

2 0 decode both , web page , data and, broadcast video -program data for 

display from a cable program source, via modem 80. . . • 

Controller 115 employs the method shown in Figure 4 
^ to produce a displayed, program guide by ..processing, and 
•:.->;.C?? m attin,g. received . program guide information that, already 
2 t 5v indudes User, selection menu options. The, process , of Figure ,4 does 
not require processor ,25 to form User, selection menu options and 
may be employed by processor 25 in its., first , configuration, for 
example. In step 205, following the start at. step 200, processor 25 
receives a transport datastream from decoder .30 that, incorporates 

3 0 User selectable menu options for display, as part of the displayed 

program guide. The User selectable options, support User initiation 
of communication functions such as .• Email, telephone, Internet 
.access, fax, video-phone, channel tuning,.,.. program, recording and 
home control functions. .. 
3 5 The data, received in step 205 also includes additional 

linking data in the program guide information. The additional 
linking., data comprises program map, conditional access and 
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network information and associates access data with the User 
selectable menu options in the displayed program^ guide. The 
. access data includes, identification codes, communication protocol 
codes, conditional access * codes, Internet access codes e.g: tJRL 
5 codes for web" page and Email access as well as telephone and fax 
numbers. The additional linking 1 data enables processor 25 to 
assemble, decode and display the prbgram content arid program 
guide information in the transport streanT from decoder 30. The 
access data enables processor 25 to communicate with external 
1 0 devices and includes different address representative codes 
corresponding to /-addresses-' of different information sources. In 
step 210, controller 115 : uses predetermined iinking data PID 
values stored in internal memory 7 in directing processor* 25 to 
identify and capture the linkirig and accesP dka 'from' the "■'received 

1 5 program gui&e iriforrhatioh. : The c^ured^'^^lihlKin^ * data is 

assembled, formatted and stored by controller 115 in internal 
• .'memory in step - 215. Also, in step 210; additional linking data 
such as » Internet- or Email addresses or telephone numbers may be 
entered by a User via an entry device such as a remote control 

2 0 unit and the additional data is incorporated in the received iinking 

data by controller 115. " 
- . ' : ^he program guide information containing the User 
selectable options, is formatted for display by controller 115 in 
conjunction with display processor 70 within processor 25 in step 

2 5 220, as previously described in connection with Figure if 'In i ^icp 

225, display processor " 70 "converts the stored and formatted 
program guide data into conventional luminance and chrominance 
components. The luminance and chrominance components, 
together with timing data - provided by controller 115, are 

3 0 processed by processor 70 for display on reproduction device 75; 

The process of Figure 4 terminates at step 230. ' 

-Controller 115 (Figure 1) employs the method shown 
in Figure 5 to produce a program guide in a video decoder from 
information received from a plurality of sources. The formed 
3 5 guide supports User , selectable communication;' functions e.g. 
Internet access, Email, fax etc. . In step 305, following the start at 
step 300, controller 115 acquires satellite program guide (SPG) 
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information, from, the satellite broadcast transport stream, received 
by processor ,25 from decoder 30. In step 310, controller 115 
acquires DVD program, guide, (DPG) information from storage 
device. 90 via interface. 95. Controller 115 acquires, collates and 
5 formats the SPG and DPG by accessing and assembling respective 
data packets to produce SPG and DPG representative pixel data for 
storage as a composite program" guide in the .unit 70 pixel map, as 
previously described, in connection with Figure 1. The SPG and DPG 
information includes linking and access data in .the form of 
10 program map, conditional- access, and network information. ...In 
other configurations, processor; 25- applies the ..principles, detailed 
herein to form a composite, program guides including, program 
guide information derived, . fro,m T: a ,., source- such as. terrestrial 
broadcast, source,; a- cai^brp^dcast -source, a .computer source,, a 

1 5. radio transn^ssi on source andr a . r sq U rce accessed? - via telephone 

lines-. ..." ........... r < .v .... ;.„.'•.-,_,'. 

. In,, step . 31,5, controller 115 creates , .User selectable 

menu options for. display {for User selection of Internet access, 
. Email, . fax etc.) in pixel data form for incorporation . ,in •.- the unit 70 

2 0 pixel memory map. In . step 315, controller, 115 also, creates ; User 

determinable menu options that enable a User, to. customize his 
program guide to include an . icon that- performs., ; a< specific User 
, requested function, for example, a User may require. . an icon that 
. .accesses a , specific internet site - or. results ; in a display of all 
2 $-ff c fA ve ^ messages. Controller 115 responds . to. . commands entered. 
: r.Y ia a data entry device, e.g. a remote control unit or keyboard, in 
. . creating , the User . determinable menu, option in accordance with 
programmed instructions. 

ControWer 115, in step. 320, examines the SPG and DPG 

3 0. information for data identifier (e.g. PID) omissions and conflicts. In 

Step 325, controller .115 re-numbers existing data identifiers and 
allocates new data identifiers as required to produce compatible 
program map information for both the collated program guide 
information and the . associated, program content. In step 330, 
3 5. cpntroller. 115 forms composite, program map, conditional access 
and network information for the composite program guide in the 
manner described in connection .with Figure 1. • 
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- - - The composite program map is formed to enable 

processor 25 to perform the communication functions selectable 
via the composite program guide. For this purpose, the composite 
program map associates a communication function PID and menu 
5 option (e.g. web page, Email, : fax icon) with the different address 
representative codes corresponding to thV addresses of the 
different information sources. In step 330, controller 115 also 
incorporates User entered data into the composite program map, 
conditional access and network information. This data may include 
1 0 items such as an Email address, a telephone/fax number, an 
Internet web page link address?; a ; credit card number etc. The 
User enters this data to processor 25 via a device such as a remote 
control or keyboard. Controller 115, ' in ! step 335, formats the ' SPG 
and DPG pixel data' together with th^ merii i option pixel* data in the 

1 5 unit 70 pixel; map created" in; step 315 td f<ii:m rr a : -Composite; 

program guide for display. - :: ' '/ . ,' r. "■■ "-. 

the composite program guide { information containing 
the User selectable menu options is formatted for display in step 
340,' and output in step 345 as previously described in connection 

2 0 with Figure 1. The process of Figure 5 terminates at step 350. 

Controller 115 (Figure 1) employs the process of Figure 
6 to automatically acquire and collate program guide information 
from a plurality of sources to form a composite program guide for 
display.' In step 405, following the start at step 400, controller 11 5 

2 5 acquires and stores satellite program guide (SPG : )^"'infdrmafibff' 

from the satellite broadcast transport stream received by 
processor 25 from decoder 30. Controller 115, in step 415, 
automatically initiates communication with DVD storage device 90 
(Figure 1), via interface 95. The communication is initiated upon 

3 0 power-up of processor 25 in response to pre-stored hardware 

configuration information defining ~ the peripheral devices -that ' are 
attached to processor 25 : and the associated communication 
protocols. This information may be contained within the received 
'• program guide information, or may be" stored : Within processor 25 
3 5 at manufacture, or may. be determined locally by' processor 25 or 
may be determined through a combination of these 1 methods. The 
local determination of hardware configuration by processor 25 
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may be accomplished either by peripheral interrogation initiated 
by 4 controller 115, or by User data entry of hardware configuration 
data. , . . 

t •„ . In alternative embodiments, communication may be 

5 . automatically initiated upon conditions such , as, a) User command 
via a. program guide option selection, for example, b) peripheral 
interrogation initiated . by controller 115 on a periodic or 
intermittent basis, or c) detection of a new or . changed electrical 
connection of processor . 25 to- a peripheral device such as DVD 
1 0 device 90. ^ 

Controller 115 ..initiates communication with DVD unit 
.90 via interface , ; 95 using communication protocol codes, 
identification codes, ..entitlement codes., and conditional access 
cod e s : .re$ri£y$(| fyoijJ 0 qje._ : access ..data'.. within the received program 

1 5 ? ui . d 4 e :. info I m ^R^- J?? slep 42Q., controller Vl 5„ directs processor .25- 

to acquire and assemble the DVD program guide .(DPG). 'information 
derived from, E^VXX. . storage device 90 . via interface 95 in the 
manner previously described in connection with Figure 1. In step 
425, controller 115 collates the SPG and DPG information by theme 

2 0 and topic by mapping the SPG and DPG information to 

corresponding theme and topic categories in a master set, also as 
described in connection with Figure 1. Further, in step 425, 
, controller 115 collates the SPG. and DPG information by source and 
} _ .allocates a different color attribute to programs and program icons 

2 \ /Fj?. m i different sources . In addition, controller 115 creates menu 
...options permitting a User to sort by source and color. 

Figure 7 shows a black and white representation of a 
color Program Guide display format, according to the invention, 
showing menu options created by controller 115 permitting a User 

3 0. to collate programs by source and color attribute. , Source icons 

905-925 are , associated with off-air broadcast, cable, radio, 
satellite and storage (e.g. DVD source 90 - Figure 1) respectively. 
Source icons 930-950 are associated with Email, telephone, 
videophone, fax and ..Internet function . sources respectively. Upon 
3 5 a -User, highlighting source, icpn 905, for example, a program guide 
is displayed , showing off-air . broadcast programs and associated' 
icons. Similarly, upon a User highlighting source icon 930, for 
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example, a program guide is displayed showing Email icons via 
which a User may activate menus for initiating composition and 
sending of Email messages and reading and deleting of messages 
received. 

5 Icon 900 is a "rainbow" sort icon showing a spectrum 

of discrete color blocks represented' by shades of gray in the "black 
and - white program guide depiction of Figure 7. The color choices 
of icon 900 may alternatively be arranged as a continuous color 
spectrum or selected range of colors in a single or a ' number of 
10 discrete color blocks. Upon a user highlighting a particular color 
within icon 900, programs from the source attributed with that 
particular color are displayed. ; For example, assuming in step 425 
controller 115 attributes the color purple to the ; DVD source device 
90, then upon a user highlighting the color : purp^' ; within ! icon 900, 

1 5 the movies available from DVD device 90 "become; displayed as a 

program: guide? Alternatively^ the" color collatibir- scheme may be 
used to identify programs by other criteria' than source. Color may 
be used' as an attribute to identify programs by theme or topic, for 
example; in which case a display of movies available for viewing 

2 0 from all sources may be identified by highlighting a red color 

within icon 900, for example. 1 In addition, program guide data may 
be collated by' attributes other than color. For example, programs 
from different sources may be attributed with different types of 
shading of different icon shapes and geometry s. u » 

25 Continuing with the process of Figure 6, in step- 430;- - 

controller 115 forms a composite program guide for display from 
the collated SPG and DPG information in a manner similar to that 
described in connection with Figure 1 . Controller 115 also, in step 
425, creates associated User selectable menu options for display 

3 0 including the User selectable program guide options for sorting by 

source -and color. The created menu options are incorporated by 
controller 115 in step : 430 in a composite program guide for 
1 display as exemplified in Figure 7. In step 435, controller 115 
formats the composite program guide information for display as 
3 5 previously described in; connection with Figure 1. The process of 
Figure 6 terminates at step 440. 
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. Controller 115 (Figure 1) employs the process of Figure 
8 to acquire web page information requested by a video receiver 
User via a selection made from options on a displayed program 
guide. In step 505, following the start at step 500, controller 115 
5 retrieves access data-in the form of • a • telephone number and 
Internet URL code, ; for example, from memory in response to a 
User selection of a web page made via a displayed program guide. 
.The access data associated with the particular User selection is 
determined, from a program guide database using program map 
1 0 information that links all 4ata . associated wyth a . particular 
program or program guide function; .. 

In step 515 ( , r controller C \15 direct^ processor 25 to 
establish, a, request., communication ; link" with : seryer 83 by: dialing 
the re triey^,, telephone, >;number using: modem 80. ..Also, iii step 

1 5 515,; ,P5QCjssor 3; ^5 { .,.en§9de J s f : and . transmits;, additional access data* 

. su9h. T as. the: .Internet loV^i^dej. using ,:the , protocpl: ;j requir ; ed.. for 
communication on the . request communication ., link. The required 
protocol is determined, from, the program, map information. In step 
520,; controller 1,15 directs processor 25 to receive and decode, an 

2 0 input signal received, on a response communication link. Controller 

115 directs processor 25 in ..identifying and retrieving the 
response web, page information from the input signal in. steps 525 
and , 5?0. - Different methods of retrieving response data from the 
input signal are employed by .processor 25 in ..steps, .525 and 530. 

2 ?)?£ e reelected , method depends . on whether or . not > the response 
. -communication; link is .the, same, link used . for- the web page data 

request. The methods used in identifying - ; and retrieving the 
response data are similar to those . previously described in 
connection with the three configurations of processor 25. 

3 0 Controller 115 applies the appropriate configuration method in 

identifying the response , web, page .data, in the input signal, in step 
,525; For this purpose, controller 115 uses data identifiers 

.determined from program map information that associates the 
. identifiers , with the User program, guide, selection.. Controller 115, 
3 5 in step. 535, formats . the response web page information for,. 

display and the Figure 8 process ends at step 540. 
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. Controller 115 (Figure 1) employs the process of - Figure 
9 for decoding both input internet information and tompressed 
video data to form a composite video output for display. Following 
the start at step 600, controller 115, in step 605,' determines 
5 packet identifiers for User requested Iiiternet data arid 
compressed image data from program map information. In step 
607, controller 115 determines whether access to the compressed 
video data and the requested Internet data is authorized from 
conditional access or smart card User entitlement information as 

1 0 previously described in connection with the third configuration of 

processor 25. 

If access is authorized, controller 115, in step 610, 
identifies the web page TCP/IP packets containing the web page 
data in a response datastream from server 83. Similarly, if access 
15 is authorized, controller 115, in step 615, identifies the 
compressed video data packets containing a User selected video 
program in an input transport stream from decoder 30 to 
processor 25. Controller 115 identifies the web page and 
compressed video data packets in a similar manner to that 

2 0 described in connection with Figure 1. 

In step 617, controller 115 directs processor 25 
(Figure 1) to decrypt Internet or compressed video data if it is 
encrypted. Controller 115 in step 620, directs processor 25 in 
decoding the identified Internet web page data using HTML™ 

2 5 processor 60. Controller 115 in step 625, directs processor 25 in 

decompressing the identified compressed video data using MPEG 
decoder 65. The resultant decoded web page data and 
decompressed video data is merged, formatted and displayed on 
unit 75 using display processor 70 under the direction of 

3 0 controller 115 in step 630. The process of Figure 9 terminates at 

step 640. 

The architecture of Figure 1 is not exclusive. Other 
architectures may be derived in accordance with the principles of 
the invention to accomplish the same objectives. Further, the 
3 5 functions of the elements of processor 25 of Figure 1 and the 
process steps of Figures 4-6, 8 and 9 may be implemented in 
whole or in part within the programmed instructions of a 
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microprocessor. In addition, the principles of the invention apply 
to any form of MPEG or non-MPEG compatible electronic program 
guide. Further, the principles , of the invention apply to 
.communication on any form of communication link including via 
5 cable, infra-red, radio, microwave, and via_a computer network. In 
.addition, it is to. be,, noted that the formation of the composite 
program guide as described herein may be performed at a location 
remote from a video receiver and . accessed by the receiver via a 
communication, network. 
10 •. . " " ' ' ' ' " '* 
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CLAIMS 

1. Video decoder apparatus for decoding' input video 
data encoded in a plurality of encoding formats, comprising: 

5 a first processor for decoding MPEG compatible data J 

identified by a first data identifier to ' provide a first decoded 
video output; 

a second processor for decoding data encoded in an 
Internet compatible data format, said Internet data being 

1 0- identified by a" second data identifier to provide a second decoded 

video output; and : - - r 

a display processor for formatting said first and second 
- decoded video outputs" for display as a : composite video image 

wherein • - ^ * • 

15 . the proportion - of : said video image 7 ^contributed by- said 

first- and se&ond decoded outputs fs r variable. L " / 

2. Apparatus according to claim 1, wherein 

1 said first and second 1 processors decode data separated 

2 0 using said first and' second data identifiers fronr a single composite 

input datastream. 



3. Apparatus according to claim 1, wherein 

% - said first processor decompresses MPEG compatible 

25 compressed data. 

4. Apparatus according to claim l; wherein 

said second processor decodes data formatted 
according to the TCP/IP protocol. 

5. Apparatus according to claim 4, wherein 

said L Internet compatible data format includes data 
encoded in at least one of a) HTML format, b) Java™ format, and c) 
ActiveX™ format. 

35 
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6. Apparatus according to claim 1, wherein 
said proportion of said video image contributed by 
said first: decoded output is variable between O. and 100%. 

5 . 7 : Apparatus... according to claim 1^ wherein 

, said display processor stores said composite video 
image in a pixel memory. 

8. Apparatus according . to claim 1,. wherein 
10 s ^ id di splay .processor- formats -^said, first ; and -second 
decoded outputs as separate images within said, .composite video 
image and 

, ■ ■. s 3 id ^ ; proportion of- r^id^icomppsite- i video vcimage 
contributed by said first and second decoded outputs is variable in 
1 5 response, ^af^eas^e of b (a) rUser^selectipn, ; ,(b)< formatting data 
received in said inp^^ideo ..data, an^^c) ; ; preprogrammed i 
processor instruction. 



it - . 



. - i A . method , for . decoding image representative input 
2 q : yideo data. .encoded, in a . plurality of encoding >:; formats, ^comprising 
the steps of: 

identifying MPEG compatible first image 
representative data; , 

^J:.-.:.^:: >- identifying, second, image . representative^ a data encoded 
2 5 in an Internet compatible data format; 

decoding said first image representative data using a 
first method to provide a first decoded, output;, ,, c ■• _. 
.:• decoding said second irnage representative data using 

a second method to provide a second decoded .output; and 
30 formatting said first and second decoded outputs for 

display as a composite ..video., .image- **erejn.. .the . proportion of said 
videoimage contributed by said first . and - second decoded outputs 
is .variable. 



OCID: <WO_8847286A1J_> 



WO 98/47286 



PCT/US97/17036 



32 

10. A method according to claim 9, further including 

the step of: 

separating said first and second image representative 
data from a single composite input datastream. 

5 • -~ : 

11. Apparatus according to claim 9, including the step 
6i • . • . . ■■- -.- .-- . 

determining whether a User is authorized to access 
said first image representative data and wherein 
10 said step of decoding said first image representative 

data occurs in response to said authorization. 

12. Apparatus according to claim 1 1 , including the step 

of ■ : - v / a ; : **-: : v [::: -^ ■ 

15' decrypting said first image representative data in' 

response to said User authorization. 

13. A method according to claim 9, including the steps 

of 

2 0 receiving program guide information and 

selecting web page information for display from said 
; received program guide information. J - 

14. A method according to claim 9, including the step 

2 5 of 

receiving an index of web page information and 

including the step of 

selecting said second image representative data from 

said index. 

30 

15. A method according to claim 9, including the step 

of 

decompressing MPEG compatible compressed first 
image representative data to provide said first decoded output. 



98/47286 



PCT/US97/17036 



3 3 

16. A method according to claim 9, including the step 
of . . \. ^ 

decoding second image representative data formatted 
5 according to the TCP/IP protocol. 

17. A method according to claim 9, including the step 

Of- . , . , : .... 

varying , said- proportion of said video image 
1 0 contributed by said first decoded output. 

18. A method according to claim 9, including the step 

decoding second image representative data formatted 

1 5 in at , leasts, pne , of a) HTMJ- formal h) Java™ , format, and c) 

ActiveX™ format. . : fl , . , _ 

19. A method according to claim 9, including the step 

of 

2 0 varying said proportion of said video image 

contributed by said first decoded output in response to at leasr 
one of (a) User selection, (b) formatting data received in said input, 
video data, and (c) pre-programmed processor instruction. 
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AMENDED CLAIMS 

[received by the International Bureau on 25 March 1998 (25.03.98); 
5 original claims 1-19 replaced by new claims 1-19 (5 pages)] 

L Video decoder apparatus for decoding input video data 
encoded in a plurality , of encoding formats, comprising: 

a first processor for decoding MPEG compatible data 
10 identified by a first data identifier to provide a first decoded video 
output; 

a second processor for decoding data encoded in an Internet 
compatible data format, said Internet data being identified by a second 
data identifier to provide a second decoded video output; and 

15 a display processor for formattmg said first and second 

decoded video outputs for display- as a composite video image wherein , 
the proportion of said video image contributed by said first 
and second decoded outputs is variable and said first and second data 
identifiers are derived from program' map information associating said 

20 Internet, data with video program content represented by said first 
decoded video output. 

2. Apparatus according to claim 1, wherein 

said first and second processors decode data separated using 
25 said first and second data identifiers . from a single composite input 
datastream. 

3. Apparatus according to claim 1, wherein 

said first processor decompresses MPEG compatible 
30 compressed data, and 

said decompressed data is synchronized with second 
decoded video output using timing data in said MPEG compatible data. 

4. Apparatus according to claim 1, wherein 

35 said second decoded video output represents an index of 

web page information. 
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5. Apparatus according to claim 1, wherein 

.the format of said Internet compatible data includes data 
encoded m at least one of a) TCP/IP format, b) HTML format, c) Java™ 
format, and d) ActiveX™ format. - - • . . . 

6. Apparatus according to claim 1, wherein 

said proportion of said video image contributed by said first 
decoded output is variable between , 0 and 100%. ■ - • 

7. Apparatus according ; to v claim : l t wherein 

. • s ^1:. ; ^ la ^r:P^#??'-.?tP«s said, composite vide*> : image' In a ' 
pixel memory. 



Apparatus, according . tp .claim- 1 , wherein • - 
said display processor formats said; first and second decoded 
outputs as separate images within said composite video image and 

said proportion of said composite video image contributed 
by said first and second decoded outputs is variable in- response to at 
least on* of (a) User selection, (b) formatting data received dn said input 
video data, and .(c) pre-programmed, processor instruction. . 
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9.. A method for decoding image representative input video 
data encoded in a plurality of encoding formats, comprising the steps of: 

deriving first and second data identifiers ~ from program map. 
information associating Internet data with video program content 
1 0 within said input video data; 

identifying MPEG compatible first image representative data 
using said first data identifier; 

identifying second image representative data encoded in an 
Internet compatible data format using said second data identifier; 
15 decoding said identified^ first image representative, data 

using a first MPEG data decoding method to provide a first decoded 
output; 

. decoding said -identified 1 ■ second irriage representative data 
using a second? Internet data decoding method to provide^ a second 
20 decoded output; and ; ! * • 

formatting said first and second decoded outputs for display 

v ... . 

as a composite video image wherein the proportion of said video image 
contributed by said first and second decoded outputs is variable, 

25 10. A method according to claim 9, further including the step 

of: - 

. separating rsaid ; first arid second images representative data 
from a single composite- input datastream. - * " , 

30 11. Apparatus according to claim 9, including the step of 

determining whether a User is authorized to access said first 
image representative data and wherein 

said step of decoding said first image representative data 
occurs in response to said authorization. 

35 

12. Apparatus according to claim 11, including the step of 
decrypting said first image representative data in response 
to said User authorization. 
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13... A method according to claim 9,. including; the steps of 
receiving program guide information and 
. receiving., web page information for display, said received 
web page information being selected from said received .program guide 
information. .., ' ■ , 

14. A method according to claim 9, including the step. of. 

receiving an index , of web page information . -and including 
the step of -.-.,.* 

receiving said second ,jmage^ representative .data selected 
from said index. . , 

, } 5 ' -.^^ ^Hf^i^^laim^^wcludiiig the:step;of 
•,.c , dec f, m P,^? siri g rM£EG compatible .compressed- first, ^hnage 
representative data to provide said first decoded output., 

A pethod according ,to ...claim 9, including the. step of, 
decoding second image representative -data formatted 'in at 
least one of a) TCP/IP format, b) HTML format, c) Java™ format and d) 
ActiveX™ format , 



1-7: : A, method according to claim 9, including the, step , of 
varying said proportion of said video image contributed by 
said first decoded output in response to at least one of (a) User selection 
(b) formatting data received in said input video data, and (c) pre- 
programmed processor instruction. 
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18. A method for decoding image representative input video 
data encoded in an Internet compatible data format, comprising the 
steps of: 

, 1 identifying . first image, representative data encoded in an 
Internet compatible data format using a first data identifier; 

... . decoding said identified firsft ^ image representative data 
using an Internet data decoding; method , to provide an index of web 
page: information associated with video program- content in said input 
video data; - /~ ... .1.1 _ 

\ identifying second image representative data encoded in an 
Internet compatible data format using a: second data identifier, said 
second irhage rejpresentatiye; data^ representing a web page selected 
from said index of web page information; ;:; ' 

decoding said identified: ^.second image representative data 
using said Internet data decoding; method, ^to provide said selected web 

page; and ; ; ; 1 

formatting said selected web page for display. 

19. ! A; method according to claim 18, including the step of 
deriving first and second data identifiers from program 

map information ^associating said selected web page with said index of 
web page information. \ . ... . 
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